Attorney Docket No. 10005753-1 



1 



PATENT 



SYSTEM AND METHOD FOR HORIZON 
CORRECTION WITHIN IMAGES 



John Michael Baron 
1940 Ridgeview Drive 
Longmont, Colorado 80504 
Citizenship: U.S.A. 



TECHNICAL FIELD 

The present invention relates to image processing to eliminate errors introduced 
during the image capture phase and more particularly, to a system and method for correcting 
errors introduced by individuals who captured the image with respect to horizontal, vertical or 
similarly well defined orientations. 
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BACKGROUND 

Cameras, and other image capturing devices, have been used by individuals to record 
visual images for many years. Earlier cameras used film in which an image was captured on 
a negative and, once captured, used to create visual images which portrayed the original 
photographed scene. More recently, digital cameras have become available and their 
5 popularity has increased over the last couple of years. Digital cameras typically record 
captured images as bitmap images in a storage device such as a VA inch disk or similar 
storage media. These stored images may be processed or modified by a computer user and 
may be printed out and used accordingly. While original digital cameras include basic 
functionality, today's digital cameras include numerous features and in some instances 

Id include features which cannot be included with film-based cameras. For instance, storage 
techniques have evolved in such a way that digital cameras may store hundreds of low 
resolution images. Additionally, digital camera users may select the resolution desired for 
images being captured. The digital camera user may select images to be recorded in low, 
medium, or high resolution modes. As the resolution of the captured image increases, the 

15 amount of memory dedicated to storing the image also increases. Digital photography also 
allows modifications of captured digital images heretofore unavailable in conventional film 
photography. 

Some types of digital cameras include built in orientation sensors. An orientation 
sensor is used to determine if the user has the camera in regular landscape mode or if the 

20 camera has been rotated to take a picture in the portrait mode. The inclusion of the 

orientation sensor allows the images to be displayed on a liquid crystal display in the correct 
orientation. One type of orientation sensor includes a metallic ball resident within a small 
enclosure. When the camera is positioned in a landscape orientation, the ball rests on the 
bottom of the small enclosure and allows a contact to be made between two pins positioned at 

25 the bottom of the chamber. This electrical contact between the two pins enables the software 
resident within the camera to determine that the camera is positioned in landscape mode. 
Similarly, if the camera is positioned in a portrait mode, the metallic ball causes an electrical 
connection to occur between two separate pins allowing the software to correctly determine 
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that the camera is in the portrait mode. This type of orientation sensor allows a 
differentiation between landscape mode and portrait mode. 

Conventional film cameras also have incorporated leveling devices to provide an 
indication when the film plane is perpendicular to the ground and level. A bubble type 
"spirit" level may be attached to an architectural view camera to provide for leveling of the 
camera body so as to insure that it is parallel to a structure to be photographed and level with 
respect to the horizontal. 

All of these prior art devices required manual orientation and positioning of a camera 
to achieve a desired effect. 
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SUMMARY OF THE INVENTION 

The present invention is directed to a system and method for correcting inadvertent 
errors in an orientation of vertical or horizontal lines within a captured image in a digital 
camera. The method of the present invention in one embodiment includes the steps of 
receiving a digital representation of an image, identifying vertical or horizontal objects within 
the image, determining the orientation errors or tilt associated with at least one of the vertical 
or horizontal objects, electronically rotating the digital representation of the image in a 
manner to eliminate the determined orientation error and displaying a corrected digital image. 

One embodiment of the system of the present invention includes a user selectable 
input, a processor which checks the user selectable input, a tilt determining mechanism which 
determines the orientation error when enabled by the processor to do so, a view finder or 
image preview display which is used to display the digital image as modified by the 
processor, and a memory to store the digital representation of the image within. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIGURE 1 is a flow diagram of a tilt correction procedure implemented by a system 
of the present invention which includes a hardware tilt sensor; 

FIGURE 2 is a flow diagram of a tilt correction procedure implemented by a system 
which includes software based orientation error detection and correction; and 

FIGURE 3 is a hardware block diagram of a camera which incorporates the present 
invention. 
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DETAILED DESCRIPTION 

Generally, the present invention relates to a method and a system which is used to 
correct the introduction of inadvertent errors of horizontal or vertical components contained 
within an image. More particularly, the present invention relates to a digital camera system 
which automatically compensates for the introduction by the user of errors in the horizon, or 
in vertical members. The automatic correction of inadvertent errors may occur, preferably in 
the digital camera, or alternatively, in the digital image itself on a computer. 

FIGURE 1 is a flow diagram which depicts a procedure used to implement a tilt 
correction feature which includes a hardware tilt sensor. In step 101, the digital image is 
captured. Since FIGURE 1 includes a hardware tilt sensor, in step 102 the hardware tilt 
sensor is interrogated to determine the actual tilt angle sensed. In step 103 a comparison is 
made between the sensed tilt angle and a maximum value of the tilt angle for correction. 
FIGURE 1 shows a maximum correction of five degrees. If the sensed tilt angle is less than 
five degrees, step 104 is executed and the digital image captured is rotated to remove the tilt 
angle. Rotation of the image may be performed using conventionally available image 
processing routines and would normally be performed prior to image compression and 
storage into memory. The rotated image is then displayed to the user. Alternatively, in step 
103 if the sensed tilt angle is determined to be greater than the maximum tilt angle of five 
degrees, the image is not rotated to remove the tilt or orientation error. This is because an 
assumption is made, that an orientation error or tilt angle of five degrees or greater must have 
been intentionally introduced by the user of the system or is present in the captured image 
and the digital image displayed in the viewfinder is not corrected. Of course, the five degree 
figure can be adjustable or removable, if desired. 

FIGURE 2 is a flow diagram of a procedure incorporated into a system in accordance 
with the present invention which includes an orientation error detection method implemented 
through software. The flow diagram of FIGURE 2 begins with a capture of the digital image 
in step 101 . Once the digital image is captured in step 101, a software program is initiated 
which attempts to determine edges of objects contained within the image in step 202. Once 
object edges are identified within the image, step 203 generates a list of a number of the 
longer straight lines included within the digital image. In step 204, the list of longer straight 

25028913 



Attorney Docket No. 10005753-1 PATENT 

7 

lines is sorted to determine the captured straight lines with the greatest length. In step 205, a 
determination is made by the software concerning whether a majority of captured straight 
lines are aligned within five degrees horizontally or vertically. A mixture of horizontal and 
vertical lines can also be successfully analyzed by the software. If a majority of the lines 
5 cannot be identified which are oriented either horizontally/vertically the orientation error or 
tilt of the digital image cannot be ascertained. However, returning to step 205, if the majority 
of the longer lines are horizontal or vertical, step 206 determines whether horizontal or 
vertical line pairs are present which are perpendicular with respect to each other. If such a 
pair exists, as determined in step 207, the longest line pair of horizontal and vertical lines are 

10T selected in step 208. Once the longest line of the pair has been determined, the orientation 

error of the horizontal and vertical pairs are determined and in step 210 the image is rotated to 
eliminate the orientation error determined. Returning to step 207, if a horizontal and vertical 
line pair have not been determined which are perpendicular with respect to each other, the 
longest line identified is used to determine the orientation error. This determination is 

15 performed in steps 211 and 212. 

FIGURE 3 includes a block diagram which depicts camera 300 which includes a 

- system in accordance with the present invention. The camera includes processor 301 which 

interfaces with user input 302, tilt sensor 303, image sensor 304, memory 305 and viewfinder 
display 306. Processor 301, which can, by way of example, be Philips DSC SAA8122A, 

20 ZORAN Corp. COACH LC, etc., accepts user input 302 from the user which may consist of a 
decision as to whether orientation error detection and correction should be performed or 
whether the user wishes to disable this feature. Processor 301 may also receive information 
from tilt sensor 303, if present. The tilt sensor function may also be implemented through a 
software routine. Processor 301 may also receive an input from image sensor 304 which 

25 captures the image. Processor 301 also stores a captured digital image in memory 305 and 
displays the corrected and/or uncorrected digital image on viewfinder display 306. Memory 
305 can be either permanently marked within the camera, removable or partially both. 
Example components suitable for memory 305 include SDRAM (MICRON Technologies 
Inc. MT48LC64M4A2), non-removable flash memory (Intel 28F320S3), removable flash- 
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card (Hitachi HB288032MM1), compact flash memory cards, memory stick, and 
SmartMedia. 
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